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Abstract 

The on-going staff training is one of critical components for the effective programming for adolescents and 
adults with autism, although it is often overlooked. The available technology can be useful to improve not only 
productivity and organization of our daily life, but also the work performance. The purpose of this study was to 
examine the effectiveness of technology on performance of instructors who are working with adolescents and adults 
with autism. The multiple baseline treatment design was used across instructors with the age between 26-34 who 
had been trained on basic knowledge and extensive application of ABA principles. The data were collected 3 to 5 
times per week via Bluetooth 1 ' and self monitoring data collection system over 2 months. The results show that 
Bluetooth " technology can be utilized for data collection effectively, and the intervention package, including 
immediate feedback, self monitoring, delayed feedback with video clips and graphs significantly improved staff 
performance across all participants. However, the videotaping sessions and the presence of supervisor have affected 
staff performance and the videotaped sessions were used for positive feedback instead of corrective feedback as the 
author indented initially. 
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Introduction 

Staff performance is one of the critical components of the effective programming for learners 
with special needs (Jahr, 1998; Parsons, & Reid, 1995; Salmento & Bambara, 2000; Parsons, Reid, & 
Green, 1993; Baker, Foxx, & Albin, 1995; Schepis, Reid, Ownbey, & Parsons, 2001). Didactic trainings 
in forms of lectures and workshops are often used to teach staff knowledge and to improve staff 
performance. However, the didactic teaching does not always translate to the application of the clinical or 
educational interventions because "knowing" and "doing" are different repertoires. For example, 
knowing the difference of various prompting procedures does not make the instructor competent to 
implement prompting procedures effectively (Parsons & Reid, 1995; Jahr, 1998; Schepis, Ownbey, 
Parsons, & Reid, 2000; Smith, 1995; Plavnick, Ferreri, & Maupin, 2010; DiGennaro, Marrtens, & 
Kleinman, 2007) 

In our verbal world, it is very natural to call learner’s name or asking the learner, “What’s next?” 
and staff may not think these as verbal prompts. However, students may develop prompt dependency 
within tasks or for transition. Just making faces or eye contact can be also a prompt for learners, but 
instructors may not realize they are even using those prompts while they are working with learners. 
Didactic teaching does not effectively address these issues. 

On-site staff training, including the frequent on-site supervision and feedback, is proven to be 
effective in order to improve staff performance (Smith, 1995; Arco, 2008; Green, Rollyson, Passante, & 
Reid, 2002; Parsons, Reid, & Crow, 2003; Salmento & Bambara, 2000; Langeland, Johnson, & 
Mawhinney, 1998; Reid, Rotholz, Parsons, Morris, Braswell, Green, & Schell, 2003; Guercio, Dixon, 
Soldner, Shoemaker, Zlomke, Root, & Small, 2005). Despite the effectiveness of on-site training, there 
are some barriers to implement this type of training consistently and frequently. First, the on-site staff 
training including staff observation and providing feedback is time consuming, especially for community 
based programs since supervisors need to visit all training sites and they lose driving time between sites. 
Secondly, implementation of the on-site training is costly. It requires many supervisors to implement 
sufficient amount of training on-going basis and within reasonable amount of time period. Thirdly, the 
presence of supervisor can be intrusive to staff, learners, and the environment, especially in the 
community. In addition to these barriers to implement on-site training, reactivity of staff to the presence 
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of their supervisors could affect the assessment of staff performance (Brackett, Reid, & Green, 2007; 
Mowery, Miltenberger, & Weil, 2010). Without having accurate data on staff performance, the 
supervisors cannot provide appropriate training for staff. This will impact the quality of service provided 
to learners. 

These barriers of providing on-site training can be minimized with utilization of available 
technology. The advancement of technology has made the various modes of environmental adaptations 
including many electronic devices available and accessible with significantly reduced cost. The 
implementation of those devices became easier due to the improved portability. Nepo (in press) and 
Satriale, Chance, and Nepo (2007) demonstrated that the Bluetooth®' technology can be effectively 
utilized for interventions to teach learners with Autism. This concept can be also applied for the on-site 
staff training. In the present study, Bluetooth® technology was implemented to collect data and provide 
immediate feedback remotely thereby time and cost for driving will be saved and reactivity will be 
decreased. 

Beside the on-site observation and feedback, the effective staff training package often include 
self-monitoring. Self-monitoring procedure consists of goal setting and recording own target behaviour 
has been proved to be effective to improve staff performance, especially when combined with other 
procedures (Petscher & Bailey, 2006; Richman, Riordan, Reiss, Pyles, & Baily, 1988; Baker, Fox, & 
Albin, 1995; Plavnick, Ferreri, & Maupin, 2010). The author incorporated the self-monitoring in this 
study not only to improve staff performance but also to monitor their awareness of own behaviours. 

The purpose of this study was to examine the effectiveness of the intervention package, including 
immediate feedback, self-monitoring, and delayed feedback with videotaped sessions and graphs, with 
utilization of commonly available technology on staff performance. A multiple baseline experimental 
design was used across participants and it was hypothesized that the intervention package incorporating 
technology will improve staff performance. 


Materials and Methods 


Methods 

Materials 

Bluetooth® : Motorola 807L, Verizon 06329N 

Cell phone with Bluetooth® capabilities: LG 810, IPhone-3G with 8GB 

Participants 

Participants were Ricky, Eric, and George who worked at a community based program for adolescents 
and adults with autism as a direct care staff. Ricky was 31 years old male instructor who had experience 
working with adolescents with autism for over 5 years. He had participated in initial and on-going 
didactic training for the basic ABA strategies prior to the current study. Eric was 27 years old male 
instructor who held a teaching certificate but did not have previous work experience with adolescents 
with autism prior to the current position. He received the initial and on-going basic ABA training in 
forms of lectures and workshops. George was 34 years old male instructor who had experience working 
with adolescents with autism for over 5 years. He received initial and on-going didactic training for the 
basic ABA strategies prior to the study. 

All participants agreed to participant in the study to improve their performance prior to the study. 
However, the details of the study regarding the target behaviors were not disclosed until their intervention 
phases. 
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Settings 

The settings for this study were vocational sites for adolescents with autism, including local convenience 
store, hotel, and restaurant. 


Target Behavior/Data Collection 

The number of unnecessary verbal prompts, including calling students’ names when students needs to be 
prompted to keep working, asking students’, “What’s next?” while the goal is students to check their 
schedule and transition independently, and providing verbal directions between steps of tasks where the 
instructional plan indicates to use physical guidance to shape the sequence, were collected for 10 minutes 
via Bluetooth" and a remote cell phone 1-2 times per week. 

IOA data 

IOA (Inter Observer Agreement) data were collected 31 % of the total sessions by a second instructor 
from the participants' school. The number of agreements was divided by the total number of sessions (the 
number of agreements plus the number of disagreement) and multiplied by 100. 100 % agreement on 
IOA was obtained. 

Procedure 

A multiple baseline experimental design was used across participants to examine the effectiveness of the 
intervention package utilizing the commonly available technology, including self monitoring, immediate 
behavior specific feedback, delayed feedback with video and graphs on staff performance. 

Baseline 

During the baseline, participants wore Bluetooth " and kept a cell phone with them (in their pockets or 
clipped to their hips). The number of verbal prompts was collected through the Bluetooth" remotely 
except the videotaped sessions. The verbal consent was attained prior to the study but participants were 
not provided information regarding their target behaviors. 


Intervention 

Participants wore Bluetooth " and kept a cell phone in their pockets or clipped to their hips, and the 
number of verbal prompts was collected remotely via Bluetooth" technology. The participants were 
reminded of the target behaviors with examples prior to each session with adolescents with autism. 
During the session, the participants monitored the number of verbal prompts they used and the immediate 
feedback was provided during and immediately after the session from the supervisor via Bluetooth". 
Videotaped sessions and graphs of their behaviors were used for feed back at the end of their day. 

Results 

The number of verbal prompts was collected via Bluetooth" successfully and remotely. The immediate 
feedback via Bluetooth ", delayed feedback with graphs and video clips, and self monitoring significantly 
reduce the unnecessary verbal prompts for all participants during the sessions with adolescents with 
autism. Initially the videotaped sessions were planned to provide corrective feedback as well as positive 
feedback for the target behavior. However, reactivity of all participants to being videotaped and the 
presence of the supervisor were very high, and the number of verbal prompts was low across phases. 
Thus, the video clips of sessions were used mainly for positive feedback during the intervention. 
Nonetheless, all participants responded positively to the intervention package. 

Ricky's verbal prompts were decreased from an average of 12.25 (8-15) times per 10 minutes to an 
average of 1.9 (0-10) per 10 minutes with implementation of the intervention package. For Eric, the 
number of verbal prompts was decreased from an average of 14.6 (9-17) times per 10 minutes to an 
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average of 1.22 (0-8) per 10 minutes after the intervention package was implemented. George’s verbal 
prompts were decreased from an average of 16.7 (9-23) times per 10 minutes to an average of 1.5 (0-12) 
per 10 minutes with implementation of the intervention. 



Figure 1. Number of Verbal prompts within 10 minutes. 

Discussion 

The increasing number of research studies shows that the use of technology can support the 
effective ABA programming (Mechiling, Gast, & Scid, 2009; Goldsmith & LeBlanc, 2004; Stromer, 
Kimball, Kinney, & Taylor, 2006; Parsons & Mitchell, 2002; Delano, 2007; Goodwin, 2008; Mechling, & 
Cronin, 2006). The results of this study indicated that the commonly available technology can be utilized 
to collect data effectively and provide on-site staff training remotely. All participants responded to the 
current intervention package positively and the unnecessary verbal prompts were eliminated to teach 
skills to adolescents with autism. It is also important to note several advantages of utilizing Bluetooth' 1 ' 
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within the intervention package here. First of all, reactivity to the presence of their supervisor was 
eliminated. Compared to videotaped sessions, all participants exhibited significantly more unnecessary 
verbal prompts during their baseline sessions with data collection via Bluetooth” which reflected their 
typical staff performance in absence of their supervisors. Thus, Bluetooth ” supported to collect accurate 
data in order to provide proper training for staff performance (Brackett, Reid, & Green; 2007). Secondly, 
cost of maintain enough supervisors and driving, especially for community based programs or programs 
with multiple sites, was reduced. Thirdly, this data collection method made on-site staff training for 
supervisors easier to provide since the supervisors could collect data remotely from their office. Fourthly, 
by incorporating Bluetooth” technology, feedback was delivered immediately which was proved to be 
more effective than delayed feedback to improve staff performance (Daniels, 1989; Schepis, & Reid, 
1994). In addition, intrusiveness to the environments, students, and staff were reduced since the 
supervisors were not physically present during the sessions. As we all agree, having extra person in the 
environments can be stigmatizing or at least not appropriate, especially in the community or in the 
inclusion classrooms. The Bluetooth technology ” had made the implementation of the intervention 
possible without the presence of supervisor. 

Despite of positive outcome of the current intervention package on staff performance, there are 
some limitations in this study need to be noted. Through Bluetooth” data collection, the possible use of 
other prompts such as gestures, facial expressions, or eye contacts, cannot be monitored even the staff 
may have used during sessions. Those prompts may require attention for further improvement of staff 
performance. All participants displayed high reactivity to being videotaped and the presence of the 
supervisor, thus the videotaped sessions were not used as corrective feedback tool as intended originally. 
Those video clips were used rather as positive feedback for the target behaviors. Self monitoring can be 
difficult at times, especially during dyads and triads instructions in the community on top of collecting 
data for learners’ behaviors. The long term effects of the intervention also need to be investigated. The 
follow up data need to be collected continuously to examine the maintenance of their behaviors. The 
network connectivity can affect the reliability of data collections. For example, if there are too many 
dropped called during the session would affect the results. Additionally, there may be individual 
difference in the reactivity to the Bluetooth®, video feedback, immediate feedback, as well as visual 
inspection. Although all participants in the current study were motivated by feedback and their own 
progress, others may feel the intervention somewhat intrusive. 

The replication studies across larger number of participants and settings are necessary to assess 
the effectiveness of the staff training utilizing the current technology. The further investigation on the 
components of this intervention, including self monitoring, immediate feedback, and video feedback, as 
well as the sequence of these components calls for the future research. The reaction to videotaping, 
wearing Bluetooth®, and data collection by others require additional analysis. In addition, the impact on 
the performance of the learners with autism by reducing the verbal prompts needs to be examined, since 
the ultimate goal of the staff performance improvement is providing the most effective treatment for 
consumers. 

As the author demonstrated and supported by increasing body of research, technology can support 
the advancement of behavioural interventions (Mechiling, Gast, & Scid, 2009; Goldsmith & LeBlanc, 
2004; Stromer, Kimball, Kinney, & Taylor, 2006; Parsons & Mitchell, 2002; Delano, 2007; Goodwin, 
2008; Mechling, & Cronin, 2006). Along with rapid advancement of technology, the more devices or 
software become readily available to be utilized as a part of behavioural interventions. It is time for more 
researchers to uncover the ways to incorporate technology into the behavioural interventions. 
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